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6.3 Communication 



FM processes, like the tasks introduced in Part I, cannot share data directly. Instead, they coordinate 
their execution and exchange data by sending and receiving messages on single-producer, single- 
consumer channels and multiple-producer, single-consumer mergers. Hence, the next step in program 
implementation after processes have been defined is to establish the channels and mergers needed for 
communication. 



In this section, we focus on the constructs and techniques used to specify structured, ''synchronous" 
communication operations (Section 2.3). In subsequent sections we examine both unstructured and 
asynchronous communication. " 



6.3.1 Creating Channels 



The basic building block from which communication structures are constructed is the channel, created 
by executing the channel statement. This statement has the general form 

CHANNEL (in= inport, out= outport ) 

and both creates a new channel and defines inport and outport to be references to this channel, with 
inport able to receive messages and outport able to send messages. The two ports must be of the same 
type. 

Optional iostat= err- specifiers can be used to detect error conditions, as in Fortran file 
input/output statements. An err= label specifier causes execution to continue at the statement with 
the specified label if an error occurs while creating the channel. An iostat== intvai specifier causes 
the integer variable intvai to be set to zero if no error occurs and to a nonzero value otherwise. If neither 
err= i^^r iostat= specifiers are provided, an error causes the FM computation to terminate. 

For succinctness, we use Fortran 90 array sections in the channel statement. An array section is like an 
array element but with a range rather than an index provided for one or more of its subscripts. A range is 
represented by a triplet with the foUov^ng general form, lower-bound : upper-bound : stride 

Bounds can be omitted if the corresponding boimds of the array are required; a stride of 1 is assumed if 
stride is omitted. See Figure 7.1 in Chapter 7 for examples of array sections. 

Array sections provided in the in= and out= components of a channel statement must be conformant^ 
that is, of the same size and shape. A channel is created for each pair of corresponding elements, as 
illustrated in Figure 6.1. 
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(a) OUTPORT (integer) po(4) 

INPORT (integer) pi (4) 

CHANNEL ( OU t=po( :) , in=pi ( : ) ) 



1^ — <nzD — 

2 ^ ) ^ 2 

3_ » ^ ) ^J^ 

4 # ^ 4 



(b) OUTPORT (integer) qo (4) 

INPORT (integer) qi (4) 

CHANNEL(out=qo(2:4) , in=qi(l:3)) 
CHANNEL(out=qo(l) , in-qi(4)) 




Figure 6.1: Array sections and the FM channel statement. In (a), a single statement creates four 
channels and, for i=l.. 4 , defines outport ^ ) and inport pi ( j_ ) to reference the same channel. 
Hence, for example, a message sent on (i) can be received on pi (ly In (b), two statements are used 
to define a ^^staggered" mapping of inports to outports, in which outport (^^^^ ( i ^4) -hi) <^^d inport 
qi( i ) r^fe^e^ce the same channel. Therefore, a message sent on (i) can be received on qi^^y 

6.3.2 Sending Messages 

A process sends a message by applying the send statement to an outport. Doing this adds the message 
to the message queue associated with the outport, with the outport declaration specifying the message 
format. For example, in the following code fragment the send statement sends a message consisting of 
the integer ^ followed by the first ten elements of the real array a- 

OUTPORT (integer, real x(10)) po 
SEND(po) i, a 

A process sends a sequence of messages by repeated calls to send; it can also call endchannel to 
send an end-of-channel (EOC) message. This usage is illustrated in Program 6.1, where the foundry 
process uses the send endchannel statements to send a total of 100 integer messages, endchannel 
also sets the value of the outport variable to be null? thereby preventing further messages from being 
sent on that port. 

Like Fortran's write endf iie statements, send endchannel nonblocking (asynchronous); 
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that is, they complete immediately. Variables named in a send statement can be modified in subsequent 
statements, without affecting the send operation. 

An operation on an undefined port is treated as erroneous. Optional err= and iostat= specifiers 
(described in Section 6.3.1) can be included in send and endchannel statements to indicate how to 
recover from this and other exceptional conditions. 

6.3.3 Receiving Messages 



A process receives a value by applying the receive statement to an inport. The inport declaration 
specifies the message format. For example, the bridge process in Program 6.1 makes repeated calls to 
the receive statement to receive a sequence of integer messages, detecting end-of-sequence by using 
the iostat specifier. A receive statement is blocking (synchronous); that is, it does not complete until 
data is available. Hence, a consumer process such as bridge cannot ''run ahead" of the corresponding 



An array size can be included in a message, thereby allov^ing arrays of different sizes to be 
communicated on the same channel. For example, the following code fragment receives a message 
comprising the integer num followed by num r^^l values. The incoming data are placed in array elements 

a(l, offset), a ( 1, of f set+1) , a ( 1, of f set+num-l ) • 

INPORT (integer n, real x(n)) pi 

integer num 

real a(128, 128) 

receive (pi) num, a (1, offset) 

An operation on an undefined port is treated as erroneous. A receive statement can include optional 
err= iostat= Specifiers to indicate how to recover from this and various exceptional conditions. In 
addition, an end= label specifier causes execution to continue at the statement with the specified label 
upon receipt of a end-of-channel message. This mechanism can be used to rewrite the bridge process of 
Program 6.1 as follows. 



producer. 



PROCESS bridge (pi) 



Process de 



INPORT (integer) pi 



Argument : 



integer num 



Local vari 



do while ( . true . ) 



While not 



RECEIVE (port=pi, end=10) num 



call use_girder (num) 



enddo 



10 



end 



! End of process 
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Example ^2 ^i^g Pipeline: 

Program 6.2 implements the ring-based pairwise interactions algorithm of Section 1.4.2 . It comprises 
a main program and a process definition. The main program uses two channel statements to create p 
channels (Figure 6.1) and a process do-loop to create p processes. One inport and one outport are passed 
to each process as arguments, thereby connecting the processes in a unidirectional ring (Figure 6.2). The 
variables i and p are also passed to the processes as arguments; this capability is discussed in Section 
6J. 

The ringnode process's fouT arguments are a unique identifier, the total number of processes, and an 
inport and outport referencing channels from one neighbor and to the other neighbor in the ring. The 
process first initializes its local state and then performs n-i send-receive-compute steps before 
terminating. 



prograiD ring 


! Main profdram 


integer P 




parauDeter (P=3) 


! P processes 


IMPORT (real xC3)) pi(P) 


! Inport declarations 


QUTPQftT (real i(3)) po(P) 


1 Outport declarations 


CHAffllEL(iD=pi(l:P-l), out=po(2:P)) 


! P-1 channels 


CHiNHELCin=pl(P)^ aut=po(l)) 


! Pth channel 


PftOCESSDO i = l^P 


! Oeate processes 


PRDCESSCALL ringnodeCi^ P^ pi(i)^ po( 


i)) 


EHDPROCESSDD 


! Block until done 


end 


! End of program 


PROCESS ringnode (i^ p, leit, right) 


! Code for single node 


IMPORT (real x(3)) leit 


! Inport (ficoraleft) 


OUTPORT (real i(3)) right 


! Outport (to right) 


integer i^ p 




real state(3)^ iorce8(3)^ iD8g(3) 


! Local variables 


call iQit8tate(i^ state) 


! Initialization 


call copy(8tate^ msg) 




call zero (1 ore e8) 




do j = 1* p-1 


! Repeat P^l times: 


SEHD (right) msg 


! Send to right 


RECEIVE(leit) msg 


! Receive from left 


call updateiorce8(]D8g, state^ lorces) 


! tJompute 


enddo 




end 


! End of process 



Program &»2 : FM implemeuLEiLioa of ciii^ piptsliue. 
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Example 5.3 Search: 

Program 6.3 implements a prototypical tree-structured computation. The program explores a binary tree 
recursivelyln the manner of Algorithm 1.1, creating a task for each tree node and returning the total 
number of leaf nodes that represent solutions. In this simple program, the tree is not represented by an 
explicit data structure; instead, a process's position in the tree is represented by an integer. 

The main program makes an initial call to the process tree- This process uses a process block to create 
recursively a set of 2n-l ( w a power of 2) processes connected in a binary tree of depth log Each 

process is connected to its parent by a channel; nonleaf processes also have channels from their two 
offspring. Notice the use of a subroutine call within a process block, as discussed in Section 6.2.2. 



http://www-unix.mcs.anl.gov/dbpp/text/node70,html 



4/3/04 



6.3 Communication 



Page 6 of 6 



program Im-tree-BxanipIe 


MaJiL program 


IMPORT (real) pi 


Inport 


OUTPOftT (real) po 


Outport 


CHAMHEL(in^i, out^o) 


Creaite channel 


PROCESSES 


Create proceaaes: 


PROCESSCALL root(pl) ! 


Root of tree 


PROCESSCALL treeCO^ 128^ po) ! 


Hee 


EHDPROCESSES ! 


Block until done 


end 


End of program 


PROCESS tree(ld^ toparent) 


Process definition 


in'tagei' id 


Process identifier 


Integar n 


Number of processes 


DUTPDRT (real) toparent 


Outport to paxent 


IMPORT (real) 11, ri ! 


Ports for children 


DUTPORT (real) lo, ro 


Ports for children 


ii(n -gt. 1) then 


If not leaf: 


CHAIIEL(in=li, out=lo) ! 


Oeate channels 


CHiJIJIEL(in=ri, out=ro) ! 


for child processes 


PROCESSES ! 


Create children: 


PROCESSCALL tree(id, n/2, lo) ! 


Left subtree 


PROCESSCALL tree(id+n/2, n/2, ro) ! 


Right subtree 


call nonleai(id, li, ri, toparent) ! 


Xode 


EHDPROCESSES ! 




else 


If leaf: 


call leal (id, toparent) 1 


Create leaf process 


endil ! 




end ! 


End of process 



Program G»3 : FM loimuLitLoa o£ si l£«e-alcu.clured compiilatioji. 
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